Sqlite error hidden inside transaction

Hello 👋
My application starts throwing SqliteException in production:
SqliteException(1): cannot rollback - no transaction is active

Moor can't rollback the transaction because sqlite is failing behind. The thing is that I can't retrieve the original sqlite error, and it was very painful to reproduce it as the error was related to memory (same as https://github.com/simolus3/moor/issues/876).
Here is the failing code:
https://github.com/simolus3/moor/blob/b3ebaeadcfb4c209c3c0f835a0fb3a5c8cae08b8/moor/lib/src/runtime/api/connection_user.dart#L367-L375
await transactionExecutor.rollback(); is throwing, so we lost the original error.
Don't you think that we should throw the original error if the rollback fails?
Something like:
catch (e) {
  try {
    await transactionExecutor.rollback();
  } catch(_) {
    throw e;
  }

  rethrow;
}

Thank you 🙏

Thank you for the report, I can see that the error recovery is pretty bad if .rollback() throws too.
On the other hand, I'm not sure if we should just swallow the fact that rollback threw an exception. Maybe we could introduce an exception class that wraps both exceptions and provides the original stacktrace:
catch (e, s) {
  try {
    await transactionExecutor.rollback();
  } catch(rollbackE) {
    throw CouldNotRollbackException(e, s, rollbackE);
  }

  rethrow;
}

A downside is that users would have to catch CouldNotRollbackException to get the right stack trace. Since we're not using rethrow in that case, the trace would appear come from moor otherwise.

I agree, ignoring the rollback exception is not ideal, even if I greatly prefer to get the original exception instead of the rollback one.
CouldNotRollbackException looks good to me. This change could be breaking, if users used to catch SqliteException, they will have to catch CouldNotRollbackException as well. But this change can save a lot of time to users if they encounter the same problem as I did.
Another way to do that would be wrapping all SqliteException with a custom moor exception that supports nested exceptions. So we will not have to deal with both SqliteException and CouldNotRollbackException. This is a bigger change but more consistent.

This has now been fixed on develop. I opted for the CoultNotRollBackException. IMO changing the types of possible exceptions is not a breaking change that would justify a major version bump. The type of exceptions thrown is essentially an implementation detail, and users typically catch all exceptions either way.


Add references to EBSA section

Adrian suggested adding these references to the EBSA section:
For the EBSAs, it would be ideal to access the report in Ref 2 (BOF) or Ref 3 (NS), which both give a lot of specifics on individual EBSAs.
2.	Buzeta, M-I. 2014. Identification and Review of Ecologically and Biologically Significant Areas in the Bay of Fundy. DFO. Can. Sci. Advis. Sec. Res. Doc. 2013/065. vi + 59 p.
3.	Hastings, K., M. King, and K. Allard. 2014. Ecologically and biologically significant areas in the Atlantic coastal region of Nova Scotia. Can. Tech. Rep. Fish. Aquat. Sci. 3107: xii + 174 p.

These references are captured in the story map resource linked in the section, so no need to include them in the report.


chore(package): update semantic-release to version 7.0.2

Codecov Report

Merging #160 into master will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff           @@
##           master    #160   +/-   ##
======================================
  Coverage    97.5%   97.5%
======================================
  Files           1       1
  Lines         120     120
======================================
  Hits          117     117
  Misses          3       3

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 147f72b...63f91ba. Read the comment docs.


Fix casting attribute to object

This pull request fixes the casting to an object.
When using array as cast type, [] would be casted to an array and back, no matter using associative arrays or not.
However, for object this was not the case. The {} was casted to an object, but the way back didn't work.

I am closing this pull request because it lacks sufficient explanation, tests, or both. It is difficult for us to merge pull requests without these things because the change may introduce breaking changes to the framework.
Feel free to re-submit your change with a thorough explanation of the feature and tests - integration tests are preferred over unit tests. Please include it's benefit to end users; the reasons it does not break any existing features; how it makes building web applications easier, etc.
Thanks!


problem when creating a new container

Is there any way to fix this? this happened after changes to this repository 10 hours ago,  Hopefully there is a way to solve this problem

It looks like /data/data/com.termux/files/ubuntu already exists,you should delete it or use another directory.
Existing directories cannot be used to store containers. This is because it is not safe, and if there is another container in the directory , it may cause the container broken.


Support QLinearAdd from onnx runtime com.microsoft contrib ops.

Interestingly, Onnxruntime doesn't actually run this op in integer, they dequantize/run it/requantize. I had to do the same here to get the tests to pass.
Has a kind of crazy way to produce contrib ops from onnx runtime for testing. Let me know what you think.

@mbrookhart I think you should make a new pull request of test_forward. Because I just find that in ONNX test_forward, your test_qlinearadd doesn't be called.

======== 82 passed, 1122 deselected, 835 warnings in 723.89s (0:12:03) =========
Something appears to be broken with how CI is running the onnx tests.


[⚡ Feature]: Generate source maps

Description
Unclear to me if this is supported or not at the moment, but wanted to flag it in case not.
My error handler, Sentry, needs source maps to map the minified stacktraces to my repo source. Currently, my webpack next.js build outputs source maps for files like this:
~/_next/static/chunks/1249.d9777ee89355e4b6.js
While the errors reported come out of Cloudflare pages like this:
__next-on-pages-dist__/webpack/62d6966c94b522734ceb09853b489431.js
Is there currently a known way to do this? I haven't been able to find anything documented or in the source.
Additional Information
No response
Would you like to help?

[ ] Would you like to help implement this feature?

We don't currently generate any sort of source map. I've spoken to someone else about this before and I personally don't think it's something that would be possible with how our tooling currently works. I may be wrong so feel free to chime in if someone disagrees with what I'm writing.
Our final worker is several steps of processing away from your source code. Your source code gets built by Next.js, it then gets transformed again by Vercel's CLI and everything is inlined into one file for each edge-runtime route, and then we process that again to generate the final worker.
The part where I think this gets tricky and near-impossible to generate source maps for is how we process the code. We take all of the Vercel functions and then dedupe and minify all the functions. The deduping process then means that we could have one code snippet for a webpack chunk that is shared by 20 different edge functions generated by the Vercel CLI, instead of there being one for each file. So all of a sudden, we have all these chunks split out of the route files that can map towards a variety of different files, thereby (i assume) making it incredibly hard to try and generate a useful source map.


Added test for value-unit association

Added a new test to ensure unit-value association

Corrected the test based on a conversation with @idazucchi , the test was only checking for a single occurrence within any entity.
Also corrected the formatting to adhere to Cypher's style guide


How to run inference for a new data?

We now support evaluating user-customised videos: https://github.com/Vchitect/VBench?tab=readme-ov-file#new-evaluate-your-own-videos. You can do this by simply turning the custom_input flag on.

#7


mpeg2decoder: report properly a port reconfiguration

Port Reconfiguration might happen at any new sequence header extension.
If a new resolution is detected and bigger to current then libva has to
restart with the new resolution.  Smaller new resolution can re-use the
current surfaces.
Also clean up code around the modified lines including the proper selection
when numberSurfaces is not given in the configBuffer
Signed-off-by: Daniel Charles<EMAIL_ADDRESS>

I will wait one day to collect comments from others.
Hi Daniel:
Could you share how to verify it? If it's not right to attach stream here. Just send mail to me.
thanks.

Verified this pull request with Skylake Linux  4.4.0-24-generic #43-Ubuntu SMP Wed Jun 8 19:27:37 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux.
Ran unittest from libyami-utils and all 39 mpeg tests passed.
lgtm.

merged as 1d9cdae2f25a5fc8c2dc6f69ac7f166905e15899


About the codes

Thanks for releasing the code. I want to know if you have got the results of the paper when using the pytorch codes.

Hi @Sun-Fan ,
If you read the readme carefully, you may see that the result is shown in the figure at the end of the readme. Since Pytorch somehow needs more GPU resources than tensorflow in this case, I could only slice the original input images into small pieces before feeding them into the model. I am quite sure that the model will perform well if it takes in whole images.
Also, I have provided a trained model for sony dataset. You may download it and try by yourself.


Add support for additional proxy options and parameters

This has not been implemented yet but would be a nice addition towards feature completeness.
See Proxy.swift#L41-L59

Implemented in #30 !


K.ctc_batch_cost()  get slice index 0 of dimension 0 out of bounds error when using online trainning (batch_size=1)

Hello, I am using CTC loss function in my model, everything were good until I tried to using online training (batch_size =1).  The error was caused by K.ctc_batch_cost function.
The error can be reproduced with the keras example "image_ocr.py" by simply set the "minibatch_size = 1 " in line 446 ( the parameter of TextImagegenerator).
I am using keras 2.0.2 with tensorflow 1.1.0 backend.
Thank you!

Hi ! I am having the same problem with Keras 2.0.6 and TensorFlow 1.2.0.

Yes. I am also having the same problem. The problem is definitely related to conversion of dense to sparse.

Glad someone already posted this.
The specific error message is

InvalidArgumentError (see above for traceback): slice index 0 of dimension 0 out of bounds.
[[Node: ctc/scan/strided_slice = StridedSlice[Index=DT_INT32, T=DT_INT32, begin_mask=0, ellipsis_mask=0, end_mask=0, new_axis_mask=0, shrink_axis_mask=1, _device="/job:localhost/replica:0/task:0/cpu:0"](ctc/scan/Shape, ctc/scan/strided_slice/stack, ctc/scan/strided_slice/stack_1, ctc/scan/strided_slice/stack_2)]]

Here is a somewhat minimal example that shows what's happening. It only occurs for batch_size exactly equal to one.
test_lstm.py.txt
@fchollet It's fairly urgent for me, so if you have any pointers where I could look, I could aid in the investigation. I tried reading the corresponding Tensorflow source code at tensorflow-master\tensorflow\core\util\strided_slice_op.cc, line 299 but as a TF beginner, progress is pretty slow so far.

Tried to get into TF debugging and was able to get this stack, if it helps:

Traceback of node construction:
[...]
7: C:\Users\bij2hi\Desktop\test_lstm\test_lstm.py
Line:     46
Function:
Text:     "loss_out = Lambda(ctc_lambda_func, output_shape=(1,), name='ctc')([y_pred, labels, input_length, label_length])"
8: Python35\lib\site-packages\keras\engine\topology.py
Line:     554
Function: call
Text:     "output = self.call(inputs, **kwargs)"
9: Python35\lib\site-packages\keras\layers\core.py
Line:     659
Function: call
Text:     "return self.function(inputs, **arguments)"
10: C:\Users\bij2hi\Desktop\test_lstm\test_lstm.py
Line:     17
Function: ctc_lambda_func
Text:     "return K.ctc_batch_cost(labels, y_pred, input_length, label_length)"
11: Python35\lib\site-packages\keras\backend\tensorflow_backend.py
Line:     3263
Function: ctc_batch_cost
Text:     "sparse_labels = tf.to_int32(ctc_label_dense_to_sparse(y_true, label_length))"
12: Python35\lib\site-packages\keras\backend\tensorflow_backend.py
Line:     3222
Function: ctc_label_dense_to_sparse
Text:     "initializer=init, parallel_iterations=1)"
13: Python35\lib\site-packages\tensorflow\python\ops\functional_ops.py
Line:     526
Function: scan
Text:     "n = array_ops.shape(elems_flat[0])[0]"
14: Python35\lib\site-packages\tensorflow\python\ops\array_ops.py
Line:     509
Function: _SliceHelper
Text:     "name=name)"
15: Python35\lib\site-packages\tensorflow\python\ops\array_ops.py
Line:     677
Function: strided_slice
Text:     "shrink_axis_mask=shrink_axis_mask)"
16: Python35\lib\site-packages\tensorflow\python\ops\gen_array_ops.py
Line:     3744
Function: strided_slice
Text:     "shrink_axis_mask=shrink_axis_mask, name=name)"
17: Python35\lib\site-packages\tensorflow\python\framework\op_def_library.py
Line:     767
Function: apply_op
Text:     "op_def=op_def)"
18: Python35\lib\site-packages\tensorflow\python\framework\ops.py
Line:     2630
Function: create_op
Text:     "original_op=self._default_original_op, op_def=op_def)"
19: Python35\lib\site-packages\tensorflow\python\framework\ops.py
Line:     1204
Function: init
Text:     "self._traceback = self._graph._extract_stack()  # pylint: disable=protected-access"


Cursor throws an error when trying to insert in SQL Server database when fast_executemany flag is set

Please first make sure you have looked at:

Documentation: https://github.com/mkleehammer/pyodbc/wiki
Other issues

Environment
To diagnose, we usually need to know the following, including version numbers.  On Windows, be
sure to specify 32-bit Python or 64-bit:

Python: 2.7.14
pyodbc: 4.0.23
OS: MacOS
DB: SQL Server
driver: ODBC Driver 13 for SQL Server

Issue
Trying to use fast execute many option to insert data to the database throws the error shown below. It works if the flag is not set.
Expected behavior:
Cursor should be able to write to database without throwing an error.
Observed behavior:
---------------------------------------------------------------------------
Error                                     Traceback (most recent call last)
<ipython-input-24-5e5f851229b4> in <module>()
      1 cursor.fast_executemany = True
----> 2 cursor.executemany(query, x.values.tolist())

Error: ('HY010', u'[HY010] [unixODBC][Driver Manager]Function sequence error (0) (SQLParamData)')

The same here:
Python: 3.5.5
pyodbc: 4.0.23
OS: Windows 10
DB: SQL Server 2017 and 2016
driver: ODBC Driver 13 for SQL Server
tried with SQL Server Native Client too.
Could not determine, where the problem is, but it seems to have to do with string data.
Installed 4.0.22 again and the problems are not there anymore.

Could you post a example table schema + Python code to reproduce it, and/or ODBC trace log? That will help with the troubleshooting.

Hey @v-chojas
It was happening while trying to insert a pandas dataframe with to_sql.
b64.txt
Thats the dataframe, pickled and base64 encoded.
You can use decoded = pickle.loads(base64.b64decode(encoded)) to turn it back into a dataframe and then you can just use encoded.to_sql() to reproduce the error. (Pandas will create a table itself, it it does not exist).
Error Message: Function sequence error (0) (SQLParamData)

Reproduced with pyodbc 4.0.23 under 64-bit Python 3.6.4 on Windows 7 with SQLAlchemy 1.2.6. Also confirmed that it is specific to 4.0.23 (4.0.22 works) and is related to string parameter values.
With pyodbc 4.0.23 this works:
import pandas as pd
from sqlalchemy import create_engine, event
cnxn_url = 'mssql+pyodbc://@SQLmyDb'
engine = create_engine(cnxn_url)

@event.listens_for(engine, 'before_cursor_execute')
def receive_before_cursor_execute(conn, cursor, statement, params, context, executemany):
    if executemany:
        cursor.fast_executemany = True

table_name = 'fast_executemany_test'
df = pd.DataFrame({'col1':[1, 2]})
df.to_sql(table_name, engine, if_exists = 'replace', chunksize = None)

ODBC trace:
numeric_ok_log.zip
However, if I change the dataframe to contain strings instead of numbers
df = pd.DataFrame({'col1':['foo', 'bar']})

then I get

sqlalchemy.exc.DBAPIError: (pyodbc.Error) ('HY010', '[HY010] [Microsoft][ODBC Driver 11 for SQL Server]Function sequence error (0) (SQLParamData)') [SQL: 'INSERT INTO fast_executemany_test ([index], col1) VALUES (?, ?)'] [parameters: ((0, 'foo'), (1, 'bar'))] (Background on this error at: http://sqlalche.me/e/dbapi)

ODBC trace:
string_fail_log.zip

Related issues are being discussed in the Stack Overflow question here.

Can you create repro with only the pyODBC calls being made?
I cannot reproduce it with this:
import pyodbc
conn = pyodbc.connect([your connection string here], autocommit=True)
stmt = conn.cursor()
stmt.execute("DROP TABLE IF EXISTS fastexecutemany_test")
stmt.execute("CREATE TABLE fastexecutemany_test([index] BIGINT NULL, col1 VARCHAR(MAX) NULL)")
stmt.fast_executemany = True
stmt.executemany("INSERT INTO fastexecutemany_test([index], col1) VALUES(?, ?)", [[1,'foo'],[2,'bar']])
print stmt.execute("SELECT * from fastexecutemany_test").fetchall()

@v-chojas - Before posting I tried to reproduce the issue with plain pyodbc but could not. That's why I went with the pandas code and the ODBC logs in case they gave a hint as to what pandas (or perhaps SQLAlchemy) was doing differently.

Also worth noting that this appears to be related to Python_3. I just tried my repro code under Python 2.7.14 and using
df = pd.DataFrame({'col1':['foo', 'bar']})

worked without complaint.

I believe that, at least in my case, the issue is caused by passing an empty string as a param to execute many. I have reproduced it with very simple code (DSN, UID and PWD excluded):
import pyodbc

cnxn = pyodbc.connect(
    'DSN={};UID={};PWD={}'.format(
        DATABASE_DSN,
        DATABASE_USERNAME,
        DATABASE_PASSWORD,
    ))

# Create a cursor from the connection
cursor = cnxn.cursor()

cursor.execute('BEGIN TRY DROP TABLE [test] END TRY BEGIN CATCH END CATCH')

cursor.execute('CREATE TABLE [test]([testcol] [nvarchar](MAX) NULL)')

cursor.fast_executemany = True
cursor.executemany('INSERT INTO [test] VALUES(?)', [['']])

cursor.commit()

For me, this fails using ODBC Driver 17 for SQL Server on Mac and Windows and on Python 2 and 3. There are a number of ways to make this code work:

Disable fast_executemany
Change empty string '' to None
Change empty string '' to a non-empty string

I also added a trace as per this issue, but it didn't seem to be particularly revealing:
[ODBC][7255][1527828468.407527][__handles.c][460]
		Exit:[SQL_SUCCESS]
			Environment = 0x7fbec2829000
[ODBC][7255][1527828468.407719][SQLSetEnvAttr.c][189]
		Entry:
			Environment = 0x7fbec2829000
			Attribute = SQL_ATTR_ODBC_VERSION
			Value = 0x3
			StrLen = 4
[ODBC][7255][1527828468.407890][SQLSetEnvAttr.c][381]
		Exit:[SQL_SUCCESS]
[ODBC][7255][1527828468.407998][SQLAllocHandle.c][377]
		Entry:
			Handle Type = 2
			Input Handle = 0x7fbec2829000
[ODBC][7255][1527828468.408150][SQLAllocHandle.c][493]
		Exit:[SQL_SUCCESS]
			Output Handle = 0x7fbec3810000
[ODBC][7255][1527828468.408722][SQLDriverConnectW.c][290]
		Entry:
			Connection = 0x7fbec3810000
			Window Hdl = 0x0
			Str In = [DSN=xxx;UID=xxx;PWD=xxx][length = 53]
			Str Out = 0x0
			Str Out Max = 0
			Str Out Ptr = 0x0
			Completion = 0
		UNICODE Using encoding ASCII 'US-ASCII' and UNICODE 'UCS-2-INTERNAL'

[ODBC][7255][1527828469.087117][__handles.c][460]
		Exit:[SQL_SUCCESS]
			Environment = 0x7fbec2801800
[ODBC][7255][1527828469.087380][SQLGetEnvAttr.c][157]
		Entry:
			Environment = 0x7fbec2801800
			Attribute = 65002
			Value = 0x7ffee0d200c0
			Buffer Len = 128
			StrLen = 0x7ffee0d200a4
[ODBC][7255][1527828469.087941][SQLGetEnvAttr.c][273]
		Exit:[SQL_SUCCESS]
[ODBC][7255][1527828469.088077][SQLFreeHandle.c][220]
		Entry:
			Handle Type = 1
			Input Handle = 0x7fbec2801800

For now, I can workaround by ensuring that I always use None instead of '', but would appreciate it if someone knows of other workarounds.

Ran into this, and replacing empty strings with " " doesn't work, either. Pandas was throwing errors trying dbPushable.replace('', None, inplace= True), so I didn't test that.
Running

Python 3.6
pyodbc 4.0.23
Pandas 0.23.0
ODBC Driver 17 for SQL Server
Windows 10

Full error:
  File "C:\ProgramData\Anaconda3\lib\site-packages\pandas\core\generic.py", line 1534, in to_sql
    chunksize=chunksize, dtype=dtype)
  File "C:\ProgramData\Anaconda3\lib\site-packages\pandas\io\sql.py", line 473, in to_sql
    chunksize=chunksize, dtype=dtype)
  File "C:\ProgramData\Anaconda3\lib\site-packages\pandas\io\sql.py", line 1156, in to_sql
    table.insert(chunksize)
  File "C:\ProgramData\Anaconda3\lib\site-packages\pandas\io\sql.py", line 670, in insert
    self._execute_insert(conn, keys, chunk_iter)
  File "C:\ProgramData\Anaconda3\lib\site-packages\pandas\io\sql.py", line 645, in _execute_insert
    conn.execute(self.insert_statement(), data)
  File "C:\ProgramData\Anaconda3\lib\site-packages\sqlalchemy\engine\base.py", line 948, in execute
    return meth(self, multiparams, params)
  File "C:\ProgramData\Anaconda3\lib\site-packages\sqlalchemy\sql\elements.py", line 269, in _execute_on_connection
    return connection._execute_clauseelement(self, multiparams, params)
  File "C:\ProgramData\Anaconda3\lib\site-packages\sqlalchemy\engine\base.py", line 1060, in _execute_clauseelement
    compiled_sql, distilled_params
  File "C:\ProgramData\Anaconda3\lib\site-packages\sqlalchemy\engine\base.py", line 1200, in _execute_context
    context)
  File "C:\ProgramData\Anaconda3\lib\site-packages\sqlalchemy\engine\base.py", line 1413, in _handle_dbapi_exception
    exc_info
  File "C:\ProgramData\Anaconda3\lib\site-packages\sqlalchemy\util\compat.py", line 203, in raise_from_cause
    reraise(type(exception), exception, tb=exc_tb, cause=cause)
  File "C:\ProgramData\Anaconda3\lib\site-packages\sqlalchemy\util\compat.py", line 186, in reraise
    raise value.with_traceback(tb)
  File "C:\ProgramData\Anaconda3\lib\site-packages\sqlalchemy\engine\base.py", line 1170, in _execute_context
    context)
  File "C:\ProgramData\Anaconda3\lib\site-packages\sqlalchemy\engine\default.py", line 504, in do_executemany
    cursor.executemany(statement, parameters)
sqlalchemy.exc.DBAPIError: (pyodbc.Error) ('HY010', '[HY010] [Microsoft][ODBC Driver 17 for SQL Server]Function sequence error (0) (SQLParamData)')

Please provide an ODBC trace; if you are using Linux/Mac, upgrade to unixODBC 2.3.7pre (available here on GitHub: https://github.com/lurcher/unixODBC/ ) if you are using ODBC Driver 17 since it fixes a logging bug, and otherwise the trace will not contain any useful information.

Not sure if this will help anyone else, but in my case in my case the issue turned out to be related to some kind of character encoding issue.  Using the code provided by v-chojas earlier in the thread, I am able to reproduce the error with this:
conn = pyodbc.connect([your connection string here], autocommit=True) stmt = conn.cursor() stmt.execute("DROP TABLE IF EXISTS fastexecutemany_test") stmt.execute("CREATE TABLE fastexecutemany_test([index] BIGINT NULL, col1 VARCHAR(MAX) NULL)") stmt.fast_executemany = True stmt.executemany("INSERT INTO fastexecutemany_test([index], col1) VALUES(?, ?)", [[1,'foo'],[2,'bar']]) print stmt.execute("SELECT * from fastexecutemany_test").fetchall()
Result:
Error: ('HY010', '[HY010] [Microsoft][ODBC Driver 13 for SQL Server]Function sequence error (0) (SQLParamData)')
But explicitly encoding the string data as ascii allowed the code to execute correctly.  This is the code I used:
stmt.executemany("INSERT INTO fastexecutemany_test([index], col1) VALUES(?, ?)", [[1,'foo'.encode('ascii')],[2,'bar'.encode('ascii')]]) print (stmt.execute("SELECT * from fastexecutemany_test").fetchall())
Result:
[(1, 'foo'), (2, 'bar')]
Environment: Python 3.6, pyodbc 4.0.23, connecting to an Azure-SQL database

I can also confirm that this affects pyodbc 4.0.23 but not 4.0.22.
Explicitly encoding the string value as @veeology mentioned works for me, though I also need to change empty strings to None as @billmccord said — not really viable if you're hoping to preserve the distinction between empty strings and NULLs (I'm pushing data from a pyodbc MySQL cursor to a pyodbc SQL Server cursor).
However I've made two further observations:

this only happens to columns declared with the varchar(max) and nvarchar(max) data types; you can confirm this by changing your (max) column length to 8000 or 4000 (or less) respectively
HY010 doesn't happen if the params value is a generator object, but definitely happens if it's a sequence; however I believe that fast_executemany behaviour doesn't occur with a generator/non-sequence as performance completely tanks when attempting to do so

My guess then is that 4.0.23 is no longer automatically preparing parameter values as binary for (max) columns during fast_executemany operations. This would be explained by my two observations here and @veeology's workaround, though the empty string thing confuses me.
I'm personally reverting to 4.0.22 as I have to write a fair bit of extra code to work around this and it incurs a performance penalty of about 25%. However if anybody does use @veeology's workaround for 4.0.23, I think you'll be wanting to encode in utf_16_le for nvarchar(max) columns and you're probably safest (codepage-wise) with utf8 for varchar(max), based on the docs here.
My setup:
Win10
ODBC Driver 17 for SQL Server (64-bit)
Python 3.6.5 and 3.7.0, both Windows 64-bit

Thanks for the trace. It appears that pyODBC is calling SQLParamData twice without ever actually sending the data for the parameter with SQLPutData. I will investigate this.

I have determined that it is caused by small bug in the code, which is not sending 0-length parameters. Try the fix here: https://github.com/mkleehammer/pyodbc/pull/425

OK, I had rolled back to 4.0.22 in order to resolve this issue, but it looks like when I run with 4.0.22 something goes screwy when I insert data. When I retrieve the inserted data, it has a bunch of '\x00' characters in between the characters of a bunch of varchars in the database. It's really weird and doesn't happen with version 4.0.23.
Any chance you can make another release with the #425 fix?

Not intentionally, but I'm not specifying an encoding anywhere. The database is the default encoding. I ran a test where I insert data and retrieve and compare. Run with 4.0.22 the test has the weird characters. Run with 4.0.23 it doesn't.

Any chance you can make another release with the #425#425, Fix DAE for 0-length parameters fix?

@mkleehammer

Never mind, I see that it is in a different repo, sorry about that. I'll try there.

Alright, I finally got the pull request that @v-chojas sent to build on Windows. Originally, I had observed that when I ran my test program on my Mac it was working. However, I just tried it on Windows after doing a manual build and I still get the following error when trying to executemany and it doesn't matter if I use an empty string or a single space:
pyodbc.Error: ('HY010', '[HY010] [Microsoft][ODBC Driver 17 for SQL Server]Function sequence error (0) (SQLParamData)')
It seems the problem is still not fixed on Windows. Please find the ODBC log attached.
SQL.LOG

I think it looks like the \x00 issue @billmccord  might be this line here, based on what you say in #432 :

https://github.com/mkleehammer/pyodbc/compare/mkleehammer:4.0.22...4.0.23?diff=split#diff-fbf1bf624bc2998181a17b14c550af0dL363
https://github.com/mkleehammer/pyodbc/compare/mkleehammer:4.0.22...4.0.23?diff=split#diff-fbf1bf624bc2998181a17b14c550af0dL709

They both can raise error 0 and also output the text about right truncation, which all seems to be tied together.
No matter what, I'm pretty sure the issue lives in src/params.cpp
I know just enough C to be dangerous, and if anyone wants they can try a tentative patch I put here:
https://github.com/tigerhawkvok/pyodbc/commit/01ad3d83e5a9d84ddf85d20eb7b5c753ca117945
It's also possible the issue is, based on this diff, that the problem originates in changing the do-while code into a straight-up while block. But I don't think that's as likely.

Please try recently released pyODBC 4.0.24.

Still no dice on 4.0.24.
I see the comment on #450, any chance this will see a release soon?

Can someone provide a workaround for this issue? I tried using old versions and changing driver but no success. it gives different errors.

@akhanna38 If you're at the beginning of a project, my recommendation would be to run away from using Python to communicate with SQL Server and use C# or something that runs natively on Windows and doesn't use ODBC. If you have to use Python, use 4.0.22, perform manual encoding as per #432 and follow my workarounds there:
https://github.com/mkleehammer/pyodbc/issues/432#issuecomment-408034383

I can confirm that PR #467 fixes the issue I had with SQLAlchemy, pandas, and fast_executemany documented in my earlier comment of this thread.

I can second @gordthompson 's confirmation. I found this series of threads around the same issue and installing from PR #467 fixed the issue for me on Windows 7.

Hi Everyone!
Any news, fixes or work-arounds about this problem? I got this error message just yesterday 15.10.2018 trying to extract from a cache db source.
Thanks

Please try PR #467

still not working my requirements:
Package         Version

python 3.7.0
numpy           1.14.5
pandas          0.23.3
pip             18.1
pyodbc          4.0.24
python-dateutil 2.7.3
pytz            2018.5
setuptools      39.0.1
six             1.11.0
SQLAlchemy      1.2.10

@maki-markie - Did you install from the code on GitHub? Your list says pyodbc 4.0.24, which does not include the fix in #467.

still having some trouble after installing the : pyodbc 4.0.0-unsupported
pyodbc.Error: ('HY000', '[HY000] [Cache ODBC][State : HY000][Native Code 400]\r\n..\venv\Scripts\python.exe]\r\n[SQLCODE: <-400>:]\r\n[Cache Error: <%0AmBs1+1^%sqlcq.SPEDITION.cls136.1>]\r\n[Location: <ServerLoop - Query Fetch>]\r\n[%msg: <Unexpected error occurred:  %0AmBs1+1^%sqlcq.SPEDITION.cls136.1>] (400) (SQLGetData)')

@maki-markie What ODBC driver are you using? That message does not look familiar.

@maki-markie - Are you working with a Caché database?

@gordthompson hi, sorry for the late reply. yes i am working with cache database. do you have any experience with this? thanks

@gordthompson #467 seems to relate more to null values than empty string values. I am testing it now.
Best workaround so far seems to be to replace empty strings with null or whitespace.

@logicalextreme re: "I believe that fast_executemany behaviour doesn't occur with a generator/non-sequence"
That does seem to be the case. Details in issue #500

Did that answer the question?  Should we close this and pursue #500?

Yes, I'd say that this can be closed. #467 addressed the main issue; the mention of #500 was just a tangent resulting from an earlier comment.

I've been watching this thread for several months and still not able to use the fast execute.
I am on the latest version . Do I need any other packages updated?  I'm googling for a work around but I'm wary of having to maintain those going forward.
Name: pyodbc
Version: 4.0.25
(pyodbc.Error) ('HY090', '[HY090] [Microsoft][ODBC Driver Manager] Invalid string or buffer length (0) (SQLBindParameter)')

@maki-markie Check your sql driver once you get the latest pyodbc. I would bet that is where the issue lies.

@eddyizm he is not using SQL Server, but I would not be surprised if the ODBC driver does not support parameter arrays; fast_executemany was originally designed for and works best with ODBC Driver 17 for SQL Server, although it may also be usable with other drivers.

I am Trying to insert the data from CSV file to SQL server dynamically using python below is the code
with open (FILENAME, 'r') as f:
#reader = csv.reader(f)
reader = csv.reader(f, delimiter=',',lineterminator='\r\n', quoting=csv.QUOTE_NONNUMERIC)
data = next(reader)
#query="Bulk INSERT " + ShortName + " From = " + infile + " with(FIELDTERMINATOR =',')"
query="INSERT into " + ShortName + " values ({0})"
#print(query)
query = query.format(','.join('?' * len(data)))
cursor_Sql = cnxn.cursor()
cursor_Sql.execute(query, data)
for data in reader:
cursor_Sql.execute(query, data)
cursor_Sql.commit()
But i am getting the pyodbc.Error: ('07002', '[07002] [Microsoft][SQL Server Native Client 11.0]COUNT field incorrect or syntax error (0) (SQLExecDirectW)') error can any one please help this?

@Puneeth2 - Your question does not appear to be related to the behaviour of pyodbc itself, so you might have better luck getting an answer on Stack Overflow.

sql server cannot find ? using python from Linux OS?
SQL Server ---in Windows OS
my application run----Linux OS?
How to solve ?sql server cannot find

@selvakarna - Your question does not appear to be related to this particular issue. Try asking for help on Stack Overflow.

I came across this bug recently.
Python: 3.7.3
pyodbc: 4.0.26
pandas: 0.24.2
SQLAlchemy: 1.3.5
OS: Windows 10
driver: ODBC Driver 17 for SQL Server

I'm having the same issue as well. I've installed the pyodbc version in #467. My pyodbc version is 4.0.18b89.

@nrhead - Try upgrading pyodbc to version 4.0.27.

Upgraded to version 4.0.27 and explicitly encoded the object type columns to ascii, it seems to be working now.
for col,dtype in tbl_df.dtypes.iteritems():
    if(dtype=='object'):
        tbl_df[col] = tbl_df[col].str.encode('ascii')

Same issue with 4.0.27
Python: 3.7.3
pyodbc: 4.0.27
OS: Windows 10
driver: ODBC Driver 17 for SQL Server

@ethan-deng - Please open a new issue and include an MCVE that clearly illustrates the specific problem you are currently seeing.

The solution of https://github.com/mkleehammer/pyodbc/issues/617
and install the bug fix helps.
pip install git+https://github.com/v-makouz/pyodbc.git@bugfix_unicode_size --user

Closed due to inactivity.

Solution is to go to the ODBC Driver created, change character format from utf-8 to ASCII. Keep changing and testing. There is server miscommunication due to character set.


Make a Historical folder for historical files

Description
Make Historical folder to place historical labelled files from userguide and dev guide into it and remove it from userguide and dev guide.
Changed Behaviour
It doesn't change flow of code
Fixes
Fixes 3138
Type of change
Choose which options apply, and delete the ones which do not apply.

Code maintenance/cleanup

Hi @SobiaAman, I've made a few comments about some issues in the code. It doesn't look a historical folder/section is added which is suspect is because you probably missed adding the new folder with git add
Please be careful to check the Files changed tab in the PR to make sure that you are not unintentionally undoing fixes that were made. I appreciate the effort put in!

Hello @yadudoc,
You're right. Actually i did it before but at that time i was working on master branch, hence after revert the changes and working on different branches i forgot to git add those changes, my bad. Thanks for pointing it out. i'll take an extra care next time .

@SobiaAman No problem at all. I'm closing this issue since this is fixed.


Change ViT train script

Change ViT training script according to new version:
https://github.com/BR-IDL/PaddleViT/blob/develop/image_classification/SwinTransformer/main_multi_gpu.py

ViT related code has been updated, so I close this issue (see commit e23569e)


Assign coordinates in HRVSatellite (and probably Satellite and OpticalFlow and maybe others)

Here's what an on-disk HRVSatellite batch looks like now (from v15):

We should assign coordinates like this:
def _set_sat_coords(dataset: xr.Dataset) -> xr.Dataset:
    return dataset.set_coords(
        ["time", "channels", "y_geostationary_index", "x_geostationary_index", "y_osgb", "x_osgb"]
    )

Which results in this:

This is a sub-task of #629


fix tdpos contract unittest error

Description
从release-v5.2同步提交版本559b082同步单元测试判断结果到release-v5.1
Fixes # (issue)
Type of change
Please delete options that are not relevant.

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

Brief of your solution
Please describe your solution to solve the issue or feature request.
How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

Codecov Report

Merging #320 (58a84bd) into release-v5.1 (808ff6f) will decrease coverage by 0.63%.
The diff coverage is 33.78%.

@@               Coverage Diff                @@
##           release-v5.1     #320      +/-   ##
================================================
- Coverage         47.40%   46.77%   -0.64%
================================================
  Files               133      133
  Lines             11407    11442      +35
================================================
- Hits               5408     5352      -56
- Misses             4876     4993     +117
+ Partials           1123     1097      -26

Impacted Files
Coverage Δ

bcs/consensus/xpoa/common.go
85.71% <ø> (ø)

kernel/contract/manager/registry_impl.go
53.33% <0.00%> (-5.21%)
:arrow_down:

kernel/engines/xuperos/chainmgmt.go
7.84% <0.00%> (ø)

kernel/consensus/pluggable_consensus.go
40.66% <30.90%> (-1.08%)
:arrow_down:

bcs/consensus/xpoa/schedule.go
47.41% <40.00%> (-0.81%)
:arrow_down:

bcs/consensus/xpoa/xpoa.go
52.83% <57.14%> (+0.42%)
:arrow_up:

bcs/consensus/tdpos/tdpos.go
44.78% <100.00%> (+1.73%)
:arrow_up:

bcs/consensus/tdpos/kernel_contract.go
30.76% <0.00%> (-21.72%)
:arrow_down:

bcs/consensus/tdpos/common.go
57.81% <0.00%> (-6.25%)
:arrow_down:

bcs/network/p2pv1/conn.go
55.10% <0.00%> (-6.13%)
:arrow_down:

... and 2 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 68ac2c7...58a84bd. Read the comment docs.

Codecov Report

Merging #320 (58a84bd) into release-v5.1 (808ff6f) will decrease coverage by 0.60%.
The diff coverage is 33.78%.

@@               Coverage Diff                @@
##           release-v5.1     #320      +/-   ##
================================================
- Coverage         47.40%   46.80%   -0.61%
================================================
  Files               133      133
  Lines             11407    11442      +35
================================================
- Hits               5408     5355      -53
- Misses             4876     4991     +115
+ Partials           1123     1096      -27

Impacted Files
Coverage Δ

bcs/consensus/xpoa/common.go
85.71% <ø> (ø)

kernel/contract/manager/registry_impl.go
53.33% <0.00%> (-5.21%)
:arrow_down:

kernel/engines/xuperos/chainmgmt.go
7.84% <0.00%> (ø)

kernel/consensus/pluggable_consensus.go
40.66% <30.90%> (-1.08%)
:arrow_down:

bcs/consensus/xpoa/schedule.go
47.41% <40.00%> (-0.81%)
:arrow_down:

bcs/consensus/xpoa/xpoa.go
52.83% <57.14%> (+0.42%)
:arrow_up:

bcs/consensus/tdpos/tdpos.go
44.78% <100.00%> (+1.73%)
:arrow_up:

bcs/consensus/tdpos/kernel_contract.go
30.76% <0.00%> (-21.72%)
:arrow_down:

bcs/consensus/tdpos/common.go
57.81% <0.00%> (-6.25%)
:arrow_down:

bcs/network/p2pv1/conn.go
55.10% <0.00%> (-6.13%)
:arrow_down:

... and 3 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 68ac2c7...58a84bd. Read the comment docs.


K-Means Predict

I've added a function that makes it possible to predict which class a certain point belongs to. It returns the index of the centroid aka. the class.
A test has been added as well.

Thank you for the in-depth feedback. I will apply the changes tonight when i get home from work.

I've implemented the changes and I hope that they are like what you imagined (Y)

Thank you for applying the changes I requested, it looks great! I've approved and merged the changes into master. Thanks again for contributing to this project :)


python-scrapyd-api#7 added method to displays daemon status.

This method doesn't takes arguments. Displays the load status of a service.

I somehow totally missed this @serbernar, great work - thank you.
I'll merge this now and get a release out hopefully at the weekend.


Refix tests

Hello @alshapton! Thanks for opening this PR. We checked the lines you've touched for PEP 8 issues, and found:

In the file pyntel4004/src/hardware/processor.py:

Line 38:5: E303 too many blank lines (2)
Line 67:5: E303 too many blank lines (2)
Line 75:25: E128 continuation line under-indented for visual indent
Line 89:33: E128 continuation line under-indented for visual indent
Line 90:33: E128 continuation line under-indented for visual indent


Fix for SSL test

@swankjesse thought I'd look into this.  Introduced in 03bb6bef
The core of the issue is around the use of sun.security.ssl.SSLSessionImpl.setAsResumption(boolean) which is used in ALPN 7.1, but not introduced until Java 8.
I wasn't seeing this fail in IDEA due to IDEA loading the OOTB 1.7 sun.security.ssl.ClientHandShaker over the jetty jar's ClientHandShaker.
Ha, but sure enough, the reason the version bump was introduced (CallTest.matchingPinnedCertification) is brought back

Feel free to commit to this branch, or whatever is easiest.  I'll look back at this next week

Is there a tracking bug for the regression in Jetty ALPN ?

No action to take here. I think we're already fixed upstream.

Though we didn't merge the code, I appreciate the fix!


ARROW-14167: [C++] Directly support dictionaries in coalesce

This was omitted from ARROW-13390. Note that even after this, there's work for ARROW-14105 to unify the type promotion rules and make them apply to dictionary indices/values as well. Contains some changes from ARROW-13358 and also updates case_when's promotion rules a bit.

Of course, this needs rebasing now :-)

Rebased (looks like MacOS/Travis tests are failing because of Homebrew/thirdparty dependencies)

I pushed an addition to the R tests that verifies that this works from the R bindings.

Great, thanks Ian!


pcsx2, pcsx2-dev: fix autoupdate and persist

Duplicate of #1259 and #1234 but with the requested changes. Those PRs seemed to have stalled so I decided to make my own.
Also closes #1233.

[X] I have read the Contributing Guide.

The pcsx2-dev checkver wants to downgrade it to 2.2.0, which is why it's failing.

It says the checks have passed now, is it fixed?


Timestamp from .FIT files

Hi! In fit/_reading.py the "DATETIME_1990 = datetime(year=1990, month=1, day=1)", used as epoch for timestamps causes the incorrect date to be returned in the timestamp. The correct value would be datetime(year=1989, month=12, day=31).
If you want a .fit file for testing, or a patch (or a pull request), just let me know.

Cheers bud, brain fart by me. Fixed with 643f025.


Unnecessairy logs

Hi, I have like every minute the following line in my log:
Küche: set homekit transition control to ""
Is there a reason for it? Or am I doing something wrong? Thx for help.
Here you can see multiple lines of my log
[3/18/2021, 3:05:02 PM] [SonosMultiroomPlatform] Wohnzimmer - Updated play state: ON
[3/18/2021, 3:05:31 PM] [Hue] Küche: set homekit transition control to ""
[3/18/2021, 3:05:31 PM] [Hue] Bürotisch: set homekit transition control to ""
[3/18/2021, 3:05:31 PM] [Hue] Büroschrank: set homekit transition control to ""
[3/18/2021, 3:06:30 PM] [Hue] Küche: set homekit transition control to ""
[3/18/2021, 3:06:30 PM] [Hue] Bürotisch: set homekit transition control to ""
[3/18/2021, 3:06:30 PM] [Hue] Büroschrank: set homekit transition control to ""
[3/18/2021, 3:07:29 PM] [Hue] Küche: set homekit transition control to ""
[3/18/2021, 3:07:29 PM] [Hue] Bürotisch: set homekit transition control to ""
[3/18/2021, 3:07:29 PM] [Hue] Büroschrank: set homekit transition control to ""
[3/18/2021, 3:07:49 PM] [SonosMultiroomPlatform] Wohnzimmer - Updated play state: ON
[3/18/2021, 3:08:28 PM] [Hue] Küche: set homekit transition control to ""
[3/18/2021, 3:08:28 PM] [Hue] Bürotisch: set homekit transition control to ""
[3/18/2021, 3:08:28 PM] [Hue] Büroschrank: set homekit transition control to ""

Fr34k

#938


Gp 3740 gsi.update dependencies

Guanyin dependencies need updating due security issues.
Update all dependencies to latest version.
Update nodejs to latest long term support release.

It looks like some of these files are already present in the repo; could you rebase onto the current state of the main branch?


Create release and make the version command receive the current version automatically

Currently, there are no releases. and the version is hard-coded v0.0.1. There should be an automatic way to get the release name.

Thanks @UrielShimony, I'll fix it soon.
Let me know if you want to work on this feature.

Added in latest version.
Using the official installation will result with the release tag (e.g. 1.0.2)
For locally built versions we will use the following format (used by git describe): v1.1.2-0-gc9c8407
Thanks for opening the issue!


M03-LAB01: Self-Agent install PS script should be on separate lines

Contact Details
<EMAIL_ADDRESS>What happened?
Exercise : 02
Task: 01
Step: 13
The code snippet shows the following:
cd
mkdir agent ; cd agent
$TARGET = Get-ChildItem "$Home\Downloads\vsts-agent-win-x64-*.zip"
Add-Type -AssemblyName System.IO.Compression.FileSystem
[System.IO.Compression.ZipFile]::ExtractToDirectory($TARGET, "$PWD")
which gives the impression it should all be part of the same line. Consider emphasizing it's actually 2 split commands:
First run:
$TARGET = Get-ChildItem "$Home\Downloads\vsts-agent-win-x64-*.zip"
followed by running:
Add-Type -AssemblyName System.IO.Compression.FileSystem
[System.IO.Compression.ZipFile]::ExtractToDirectory($TARGET, "$PWD")
Repro steps:

If you copy everything on the same line, the PowerSHell script throws an error" Get-ChildItem: A Parameter cannot be found that matches parameter name 'AssemblyName'

Lab
Lab 03 Configuring agent pools and understanding pipeline styles
Relevant screenshots

Do you want to help us? 👏

[ ] Create a Pull Request by following this project's Contribution Guide

It doesn't give me the impression to use this on one line at all, hence its separate lines. And it works fine if you just copy & paste.

yes, got fixed with a 'new line return' in the description...

@LuizMacedo This should be marked as closed as it was already implemented by @petender.

Thanks all!


Switch to shared_preferences for local storage/persistent configurations

http local storage works well on web, but is not persistent on other platforms (closing an app/updates/reinstall).

Completed with c56577812d0f916439365b24d16e0758f6ab1c9a


newest version of pint breaks unit tests

upgrading pint causes unit tests to fail as discovered by @galbramc

It looks like it changes some property that used to be a Quantity to being a Unit. Sigh.

@hgrecco we would respectfully welcome any high-level advice/input you might have

One breaking change is that ureg.meter now yields the Unit, not the Quantity. Use 1. * ureg.meter` to get a quantity.
But if you provide the output of the tests I will be happy to give you better feedback.

That seems like it's probably the issue, thanks!

currently sitting with a new user who has failing unit tests due to this issue and a new install of pint. this is a huge priority.

40m ahead of you (phew)


chore(ui): update deps and improve docs

Do you mind checking for the build error @antfu ?
Might be related to unocss 0.50.0? https://github.com/nuxt/ui/actions/runs/4245468275/jobs/7381016405#step:8:64


Make wget run

wget still doesn't properly work in colab. It doesn't download the actual json files. #23

Fixed issue by using the link to the raw user content


Correct spelling

Correct spelling : Statistisc---> Statistics

@clalancette could you take a look when you have time?

@demonwu123 Thanks for the contribution.  I ended up cleaning up the Eclipse tutorials much more heavily, and this now looks good to me.

@Mergifyio backport rolling dashing


Inline a few header methods

If these methods are not inlined, they'll cause "duplicate definition"
errors when used in a program that has multiple translation units.
TESTED: caused build failures in upcoming reboot-dev/respect change
previously, build failures now resolved.

I believe the windows build failure is due to an issue @benh is already debugging; I'll wait for a fix from @benh


No cards rendered on the website

There are currently no cards at all available on bioimage.io (neither models, datasets or applications). Here's what I see when I list all:

Note that we now also have some models that should be displayed, e.g. https://github.com/bioimage-io/collection-bioimage-io/blob/main/collection/10.5281/zenodo.5764892/resource.yaml

There was an unmerged PR, now it should have been fixed.


Change text of the done button

It would be nice if I can change the text for the done button.
Thank you.

In the current version you can set an image to the button.
I will make that possible in a future version.


Doorkeeper installation fix

The correct url is https://github.com/doorkeeper-gem/doorkeeper
The prefered bundler method to user github is `gem 'doorkeeper', github: 'doorkeeper-gem/doorkeeper', ref: 910112
current Doorkeeper version is > 4.0, we don't need the step above :)

Thanks


[SPARK-29604][SQL][FOLLOWUP][test-hadoop3.2] Let SparkSQLEnvSuite to be run in dedicated JVM

What changes were proposed in this pull request?
This patch addresses CI build issue on sbt Hadoop-3.2 Jenkins job: SparkSQLEnvSuite are failing. Looks like the reason of test failure is the test checks registered listeners from active SparkSession which could be interfered with other test suites running concurrently. If we isolate test suite the problem should be gone.
Why are the changes needed?
CI builds for "spark-master-test-sbt-hadoop-3.2" are failing.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
I've run the single test suite with below command and it passed 3 times sequentially:
build/sbt "hive-thriftserver/testOnly *.SparkSQLEnvSuite" -Phadoop-3.2 -Phive-thriftserver

so we expect the test suite will pass if we isolate the test suite.

Test build #113010 has started for PR 26342 at commit 0d4cf7a.

cc. @dongjoon-hyun

Test build #113010 has finished for PR 26342 at commit 0d4cf7a.

This patch fails SparkR unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113010/
Test FAILed.

Test build #113033 has started for PR 26342 at commit 0d4cf7a.

Thank you for the patch, @HeartSaVioR !

Test build #113033 has finished for PR 26342 at commit 0d4cf7a.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/113033/
Test FAILed.

For reviews, our Jenkins is recovered after this PR.

https://amplab.cs.berkeley.edu/jenkins/view/Spark QA Test (Dashboard)/job/spark-master-test-sbt-hadoop-3.2/687/

And, I triggered another one to make it sure.

https://amplab.cs.berkeley.edu/jenkins/view/Spark QA Test (Dashboard)/job/spark-master-test-sbt-hadoop-3.2/688/

Thanks for the quick handling of this!


Question about Camera Models for synthetic/real datasets

Hey, thank you for the awesome work.
I was attempting to replicate your work and realized that I had made the assumption that the camera model for the synthetic and real datasets was identical. I assume this is not true, but I had some trouble finding the camera model for the real data. Where in the code is it, or what's the difference between the synthetic and real camera models?

Hi, my apologies for the super delayed response.
Both the synthetic and real camera models are assumed to be simple perspective cameras.


Pageable sort parameter

Hi,
Was the intended purpose of sort to use actual db column names?
For example:
I call this repository in spanner (which extends SpannerRepository<Tenant, Key>)
tenantRepository.findAll(pageable) with pageable being:
number:0
size: 20
sort: tenantName ASC
if I use tenantName it does not work and throws: com.google.cloud.spanner.SpannerException: INVALID_ARGUMENT: Unrecognized name: tenantName; Did you mean tenant_name? [at 1:47]
SELECT * FROM (SELECT * FROM tenant) ORDER BY tenantName ASC LIMIT 20 OFFSET 0
if i use tenant_name it does work.
is that a correct behaviour?
thx

When specifying the sort like Sort.by(Order.asc("column_name")) we think it makes most sense that since you are providing the string column name to sort on that you should provide the Spanner table's column name, and NOT the string name of the java property.
In your situation, is "tenantName" the name of the java property, while "tenant_name" is the name of the column in the Spanner table?

When specifying the sort like Sort.by(Order.asc("column_name")) we think it makes most sense that since you are providing the string column name to sort on that you should provide the Spanner table's column name, and NOT the string name of the java property.

@ChengyuanZhao I'm not sure about this because everywhere in the Spring Data docs that parameter is  calls "property", not "column", and I'm pretty sure if you're using Spring Data JPA, you'd be passing in the mapped property name, not the column name. @mp911de WDYT?

I see, I will make the change according to Mark's description and make a PR.

Change merged now. It now first checks if the given name is that of a java property. If not, then it uses the given name directly as the column name.

Thx @ChengyuanZhao
Great job


Add permute_along_batch/seq

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (1b9c4c3) 100.00% compared to head (f04b6b0) 100.00%.

:exclamation: Current head f04b6b0 differs from pull request most recent head f37ffe7. Consider uploading reports for the commit f37ffe7 to get more accurate results

Additional details and impacted files
@@            Coverage Diff            @@
##              main       #15   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            5         6    +1
  Lines           46        61   +15
  Branches         0         2    +2
=========================================
+ Hits            46        61   +15

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


✨📝 create consultancy page html file #11

Description
Fixes #11
Type of change

[x] New feature (non-breaking change which adds functionality)

Checklist

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my code
[x] I have commented my code, particularly in hard-to-understand areas
[x] My changes generate no new warnings

I worked on this with @https://github.com/paul-nadola and @https://github.com/Johnsonnjichi

Good attempt closing this pr as it is already done, please pick another issue


Cleaned up token test and added a warning

The TOKEN increment mode only works as expected when the ByteOrderedPartitioner is being used.
This is generally not recommended due to hotspots but in certain cases might be helpful to avoid ALLOW FILTERING and the lack of a LIMIT on time based polling of Cassandra table.
It can be used with other partitioners but inserts can be missed that occur after a query is run because other partitioners have no order in the way tokens are ordered.

Note: after doing a pull from upstream had trouble w/ some of the temp classes.
So added this in the older branch.

Note: after doing a pull from upstream into fork got some errors with missing temp classes.
So added these changes in the older branch

@CodeSmell
can you please resolve the merge conflicts so i can merge?

Thanks!


Update Get-SPCertificateAuthority.md

Replaced example

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

sharepoint/sharepoint-ps/sharepoint-server/Get-SPCertificateAuthority.md
:white_check_mark:Succeeded
View (sharepoint-ps)

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


StringHelpers & small bugfixes

Add StringHelpers class (contains getters for common strings)
Small bugfixes on RemoveFirstAny, and RemoveLastAny
Reworked IsOpenWrapChar and IsCloseWrapChar (Use StringHelpers)

Can i import packages like crypto? I have the following code and I think it makes sense to integrate with string_extensions
import 'dart:convert';
import 'package:convert/convert.dart';
import 'package:crypto/crypto.dart' as crypto;
import 'package:string_extensions/string_extensions.dart';

extension OtherMiscExtensions on String? {
  // Return a MD5 hash of current `String`
  String? get md5 {
    String? data = this;
    if (data.isNotBlank) {
      var content = const Utf8Encoder().convert(data!);
      var md5 = crypto.md5;
      var digest = md5.convert(content);
      data = hex.encode(digest.bytes);
    }
    return data;
  }
}

If you agree, I add and do a PR

Hey thanks again for the contribution! I think we are ok with ‘crypto’. However let’s not create many dependencies to foreign packages.

I also don't like external dependencies on these kind of packages (extension packages). I'm new to flutter, so I preferred to confirm beforehand if crypto was some external dependency. I will make a pull request then

I will merge it for now, if we get projects breaking due to dependency issues we will remove md5 method. Cheers.


Porting latest changes from master branch to live branch.

Organizational Auto Attendant (OAA) Hybrid support was GA'd today. This PR will move the updated documentation of OAA cmdlets to live branch.

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

sharepoint/sharepoint-ps/sharepoint/Add-SPServerScaleOutDatabase.md
:white_check_mark:Succeeded

sharepoint/sharepoint-ps/sharepoint/Clear-SPServerScaleOutDatabaseDeletedDataSubRange.md
:white_check_mark:Succeeded

sharepoint/sharepoint-ps/sharepoint/Clear-SPServerScaleOutDatabaseTenantData.md
:white_check_mark:Succeeded

sharepoint/sharepoint-ps/sharepoint/Export-SPServerScaleOutDatabaseTenantData.md
:white_check_mark:Succeeded

sharepoint/sharepoint-ps/sharepoint/Get-SPServerScaleOutDatabase.md
:white_check_mark:Succeeded

sharepoint/sharepoint-ps/sharepoint/Get-SPServerScaleOutDatabaseDataState.md
:white_check_mark:Succeeded

sharepoint/sharepoint-ps/sharepoint/Get-SPServerScaleOutDatabaseInconsistency.md
:white_check_mark:Succeeded

sharepoint/sharepoint-ps/sharepoint/Get-SPServerScaleOutDatabaseLogEntry.md
:white_check_mark:Succeeded

sharepoint/sharepoint-ps/sharepoint/Import-SPServerScaleOutDatabaseTenantData.md
:white_check_mark:Succeeded

sharepoint/sharepoint-ps/sharepoint/Split-SPServerScaleOutDatabase.md
:white_check_mark:Succeeded

skype/skype-ps/skype/Get-CsOrganizationalAutoAttendant.md
:white_check_mark:Succeeded

skype/skype-ps/skype/Get-CsOrganizationalAutoAttendantStatus.md
:white_check_mark:Succeeded

skype/skype-ps/skype/Get-CsOrganizationalAutoAttendantSupportedLanguage.md
:white_check_mark:Succeeded

skype/skype-ps/skype/Get-CsOrganizationalAutoAttendantSupportedTimeZone.md
:white_check_mark:Succeeded

skype/skype-ps/skype/Get-CsOrganizationalAutoAttendantTenantInformation.md
:white_check_mark:Succeeded

skype/skype-ps/skype/New-CsOnlineAudioFile.md
:white_check_mark:Succeeded

skype/skype-ps/skype/New-CsOnlineSchedule.md
:white_check_mark:Succeeded

skype/skype-ps/skype/New-CsOnlineTimeRange.md
:white_check_mark:Succeeded

skype/skype-ps/skype/New-CsOrganizationalAutoAttendant.md
:white_check_mark:Succeeded

skype/skype-ps/skype/New-CsOrganizationalAutoAttendantCallFlow.md
:white_check_mark:Succeeded

skype/skype-ps/skype/New-CsOrganizationalAutoAttendantCallHandlingAssociation.md
:white_check_mark:Succeeded

skype/skype-ps/skype/New-CsOrganizationalAutoAttendantCallableEntity.md
:white_check_mark:Succeeded

skype/skype-ps/skype/New-CsOrganizationalAutoAttendantDialScope.md
:white_check_mark:Succeeded

skype/skype-ps/skype/New-CsOrganizationalAutoAttendantMenu.md
:white_check_mark:Succeeded

skype/skype-ps/skype/New-CsOrganizationalAutoAttendantMenuOption.md
:white_check_mark:Succeeded

skype/skype-ps/skype/New-CsOrganizationalAutoAttendantPrompt.md
:white_check_mark:Succeeded

skype/skype-ps/skype/Remove-CsOrganizationalAutoAttendant.md
:white_check_mark:Succeeded

skype/skype-ps/skype/Set-CsOrganizationalAutoAttendant.md
:white_check_mark:Succeeded

skype/skype-ps/skype/Update-CsOrganizationalAutoAttendant.md
:white_check_mark:Succeeded

teams/docfx.json
:white_check_mark:Succeeded

teams/docs-conceptual/index.md
:white_check_mark:Succeeded

teams/docs-conceptual/intro.md
:white_check_mark:Succeeded

teams/docs-conceptual/overview.md
:white_check_mark:Succeeded

teams/docs-conceptual/toc.yml
:white_check_mark:Succeeded

teams/mapping/monikerMapping.json
:white_check_mark:Succeeded

teams/teams-ps/teams/Add-TeamUser.md
:white_check_mark:Succeeded

teams/teams-ps/teams/Connect-MicrosoftTeams.md
:white_check_mark:Succeeded

teams/teams-ps/teams/Disconnect-MicrosoftTeams.md
:white_check_mark:Succeeded

teams/teams-ps/teams/Get-Team.md
:white_check_mark:Succeeded

teams/teams-ps/teams/Get-TeamChannel.md
:white_check_mark:Succeeded

teams/teams-ps/teams/Get-TeamFunSettings.md
:white_check_mark:Succeeded

teams/teams-ps/teams/Get-TeamGuestSettings.md
:white_check_mark:Succeeded

teams/teams-ps/teams/Get-TeamHelp.md
:white_check_mark:Succeeded

teams/teams-ps/teams/Get-TeamMemberSettings.md
:white_check_mark:Succeeded

teams/teams-ps/teams/Get-TeamMessagingSettings.md
:white_check_mark:Succeeded

teams/teams-ps/teams/Get-TeamUser.md
:white_check_mark:Succeeded

teams/teams-ps/teams/New-Team.md
:white_check_mark:Succeeded

teams/teams-ps/teams/New-TeamChannel.md
:white_check_mark:Succeeded

teams/teams-ps/teams/Remove-Team.md
:white_check_mark:Succeeded

teams/teams-ps/teams/Remove-TeamChannel.md
:white_check_mark:Succeeded

This comment lists only the first 50 files in the pull request.
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


'WebSQL is not supported by plattform' although using memory

Hi,
when trying to connect to my database schema with the memory datastore parameter I get the following error:

Not supported: (353) WebSQL is not supported by platform.

Here is my (demo) code:
import * as lovefield from 'lovefield';

console.log('DatabaseWebWorker Initialized');

const schemaBuilder = lovefield.schema.create("foo", 1);
schemaBuilder.setPragma({ enableBundledMode: true });
schemaBuilder.createTable("Item").addColumn("id", lovefield.Type.INTEGER); // <- If I comment out this line, the browser doesn't crash.

schemaBuilder.connect(null, lovefield.schema.DataStoreType.MEMORY, null).then(function(db) {
  console.log("Success!");
});

The documentation says (https://github.com/google/lovefield/blob/master/docs/spec/03_life_of_db.md):

If neither IndexedDB nor WebSQL is supported, use lf.schema.DataStoreType.MEMORY.

So I would expect that it should work even without supporting WebSQL ?
Thanks in advance !

connect() accepts a single object parameter, not three parameters. See example at https://github.com/google/lovefield/blob/8f4f5faac5e6b827f8892e0c77a47fc843aad265/tests/base/close_test.js#L52 on how to properly use connect() with MEMORY.

Posting one more example from the demos/ folder, https://github.com/google/lovefield/blob/741cef2e35ccdaa0b27b03edfed883e7e78c0f18/demos/todo_typescript/todo.ts#L34-L36.

@freshp86 thanks a lot. I already assumed that it's pretty obvious. But that is that obvious - wow. A little bit embarrassing.  Thanks, thanks, thanks !


not possible to deploy with app level credentials?

Is it not possible to deploy with app level credentials? This doc says it should: https://docs.microsoft.com/en-us/azure/app-service/app-service-deployment-credentials
I keep getting unauthorized though, I used the credentials found in the publish profile. Tried all variations of the username.
It does work with user level credentials but according to the documentation you can deploy to every app with the same user?! So no segregation between environments is possible.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4581be64-415a-804a-0a45-25b6976095c3
Version Independent ID: 0cae0e82-c263-e2cf-ea54-a783291f5746
Content: Zip push deployment for Azure Functions | Microsoft Docs
Content Source: articles/azure-functions/deployment-zip-push.md
Service: functions
GitHub Login: @ggailey777
Microsoft Alias: glenga

Thanks for the feedback! We are currently investigating and will update you shortly.

@mrdfuse to clarify, are you having issues deploying a Function App with App Level Credentials using a Zip Push Deployment? Or are you have an issue with App level credentials in your functions apps in general?

The first one, I was trying to deploy a Function App with Zip Push deployment using the app level credentials. Maybe I did something wrong but I tried all variations of username/password. I extracted those from the publish profile as documented in the Azure docs. Using the user level credentials worked from the first try.

@mrdfuse thank you for clarifying that.
I have assigned this to the content author to take a look and help if possible.
@ggailey777 can you take a look and see if you can help out here?

@mrdfuse the article that you are citing is not about zip push deployment but about a standard Git or FTP-based deployment. I'm not sure that zip push deployment currently supports app level credentials. @cephalin do you happen to know?

Yes you are right, I have no idea how I arrived at that conclusion. I remember having too many tabs open figuring out how to deploy Azure Functions :) Sorry!
But it might be useful to support in the future? Like I said, I don't like that one user can deploy to all my environments in Azure.

@mrdfuse I agree that would probably be a helpful feature addition. You are welcome to propose it here. If there's nothing else for this issue, you can please close it for us. Thanks again for contacting us with your question.

Ok, done, please vote :) https://feedback.azure.com/forums/355860-azure-functions/suggestions/33612868-zip-deploy-functions-with-app-level-credentials-in


TypeScript JSX should have been named TypeScript TSX

Does this issue occur when all extensions are disabled?: Yes

VS Code Version: 1.75.0
OS Version: Any

Steps to Reproduce:

Look at VSCode Release Notes for 1.75.0
Look at VSCode Language Selector

The release notes state Typescript React has been renamed to Typescript TSX however in VSCode it is Typescript JSX. Given the file extension is .tsx for Typescript, I agree with the release notes that it should be TSX.
Release Notes

Language Selector

See https://github.com/microsoft/vscode/pull/173333 Will fix release notes


Update dependencies to Kubernetes 1.16.3

Towards giantswarm/giantswarm#7675

This can also be removed https://github.com/giantswarm/cluster-autoscaler-app/blob/master/integration/templates/cluster_autoscaler_values.go#L6

This can also be removed

@sslavic True but we didn't remove it from any of the other PRs.

Yeah, sorry, missed it, was looking for it in the other PRs but in wrong place.

@sslavic No worries and good to get this cleaned up. 👍


ServiceResult additional implementation

It would be nice to have a ServiceResult implementation without the Data property to handle void actions properly.

Implementation -> #27


wallet connector gives error on localhost

When clicking one of the wallets I get error. Copy from console
Error: window.cardano() is not injected by the user
    get wallet CardanoAPI.ts:28
    _callee$ Commands.ts:21
    Babel 20
    connectWallet useWallet.ts:40
    onClick SelectWalletModal.tsx:31

@Mik-A  Make sure that you have wallet browser extensions installed such as: ccvault, nami or yoroi.
If they are not installed then window.cardano won't be injected by extensions

I do have Yoroi extension installed. In Firefox.
I will try installing extension on brave browser and see if that works.
However Firefox should not be neglected. The error prompt could be a bit more descriptive, I think

FYI I got it to work with ccVault and Brave. Firefox and Yoroi not

@Mik-A if you got it to work with ccvault and Brave, can you submit PR fixing it if there were changes needed? Thank You!

Okay, sounds like extension code is executed after our code and therefore we need to have some waitFor(window.cardano, callback) mechanism

#25 I tried to add waitFor logic, lets check when it will go live

It will go live this week for sure.

Can you verify now @Mik-A ?


test(tabs): add performance tests for mat-tabs

Overview

Renders a tab group with 3 tabs.
Renders a tab group with 10 tabs.
Switches between three tabs.

This performance test cannot be merged in until PR #38026 is completed. I will revisit this PR once it is merged.


EmberCLI failed to generate an index.html file.

hi all, is there a way i can debug this? Getting error on Heroku, locally the app is running just fine (DigitalOcean).
Many thanks.
EmberCli::BuildError in Account#index
Showing /app/vendor/bundle/ruby/2.3.0/gems/ember-cli-rails-0.7.0/app/views/ember_cli/ember/index.html.erb where line #1 raised:

          EmberCLI failed to generate an `index.html` file.
Extracted source (around line #25):

25:        app.check_for_errors!

        raise BuildError.new <<-MSG
          EmberCLI failed to generate an `index.html` file.
        MSG
      end

Rails.root: /app

Trace:
vendor/bundle/ruby/2.3.0/gems/ember-cli-rails-0.7.0/lib/ember_cli/deploy/file.rb:25:in `check_for_error_and_raise!'
vendor/bundle/ruby/2.3.0/gems/ember-cli-rails-0.7.0/lib/ember_cli/deploy/file.rb:14:in `index_html'
vendor/bundle/ruby/2.3.0/gems/ember-cli-rails-0.7.0/lib/ember_cli/app.rb:61:in `index_html'
vendor/bundle/ruby/2.3.0/gems/ember-cli-rails-0.7.0/app/helpers/ember_rails_helper.rb:11:in `render_ember_app'
vendor/bundle/ruby/2.3.0/gems/ember-cli-rails-0.7.0/app/views/ember_cli/ember/index.html.erb:1:in `_vendor_bundle_ruby_______gems_ember_cli_rails_______app_views_ember_cli_ember_index_html_erb__3698659512889612043_70218682884580'
vendor/bundle/ruby/2.3.0/gems/actionview-4.2.0/lib/action_view/template.rb:145:in `block in render'
vendor/bundle/ruby/2.3.0/gems/activesupport-4.2.0/lib/active_support/notifications.rb:166:in `instrument'
vendor/bundle/ruby/2.3.0/gems/actionview-4.2.0/lib/action_view/template.rb:333:in `instrument'
vendor/bundle/ruby/2.3.0/gems/actionview-4.2.0/lib/action_view/template.rb:143:in `render'

@movstox thanks for opening this issue and bringing it to our attention.
Have you followed along with the Setup Instructions, particularly:
$ cd path/to/frontend
$ ember install ember-cli-rails-addon

If so, what version of the addon are you running?
Have you followed all the steps in the Heroku section?

@seanpdoyle I'm running "ember-cli-rails-addon": "0.7.0" as well.
I've upgraded from 0.5.8 and when I start rails s on my Digital Ocean dev server it works.
When I deploy to Heroku - it doesn't, is there a way to find out why index.html is not found? i.e. logs...

Also, I had to modify bin/heroku_install (added cd ..):
#!/usr/bin/env sh

set -e

bower="$(pwd)/node_modules/.bin/bower"

for app in "account" "admin"; do
  cd $app &&
    npm install &&
    $bower install
  cd .. # added this line
done

What is the output of $ heroku buildpacks?
ember-cli-rails depends on the presence of the assets:precompile task. Does your application have that rake task available (try rake -T | grep assets)?
Also, for what it's worth, your changes to bin/heroku_install should be covered in the future by https://github.com/thoughtbot/ember-cli-rails/pull/379

The error message you're seeing is somewhat vague because, in theory, it should never be reached. That is to say, if your project is properly configured and there are issues with compiling your Ember application, they would be raised elsewhere (for instance, in the call to App#compile that will raise build errors).
This leads me to believe that your application is never invoking the ember:compile task.

Does this help?
$ heroku buildpacks
1. https://github.com/heroku/heroku-buildpack-nodejs
2. https://github.com/heroku/heroku-buildpack-ruby

$ rake -T | grep assets
rake assets:clean[keep]                       # Remove old compiled assets
rake assets:clobber                           # Remove compiled assets
rake assets:environment                       # Load asset compile environment
rake assets:precompile                        # Compile all the assets named in config.assets.precompile

@movstox yup, looks like you're properly configured there.
What about the output of
$ heroku config | grep SKIP_EMBER

@seanpdoyle it's empty!

RACK_ENV:                 production
RAILS_ENV:                production

Hmm, this is a real head scratcher.
Would you mind trying to compare your application to https://github.com/seanpdoyle/ember-cli-rails-heroku-example, being on the lookout for configuration differences?

Ok, this would take me some time.

Also, does it make sense to run heroku run rake ember:compile and see the output?

Also, does it make sense to run heroku run rake ember:compile and see the output?

That's a great idea!

@seanpdoyle Finnally, changed the deployment strategy to the one based on Redis(index.html) / S3(assets). I suppose in this case I don't need heroku-buildpack-nodejs on Heroku at all...

@movstox have you been using the Redis deployment strategy from the start?

@seanpdoyle no, but I was not able to find the explanation for my issue. Perhaps, it's about Heroku, since my app worked on DigitalOcean and locally. S3/Redis was already available so I've just opted for that.

changed the deployment strategy to the one based on Redis

@movstox are you using https://github.com/seanpdoyle/ember-cli-rails-deploy-redis?

@seanpdoyle yes. The only thing I would like it to be able to do is allowing to setup the namespace via env var (i.e. 'appname:index').

@movstox that's great!

The only thing I would like it to be able to do is allowing to setup the namespace via env var (i.e. 'appname:index').

I agree, that would be a great feature.
PRs are welcome!
I'm also currently working on a project that uses that strategy so be on the lookout for coming improvements.
Closing this issue for now.

@seanpdoyle thanks for your input and good luck.

hey there! i'm getting this same error, and heroku run rake ember:compile isn't fixing it.
unfortunately i need to be able to ship this asap. any advice?
heroku config | grep SKIP_EMBER --> is empty
heroku buildpacks:

heroku/nodejs
heroku/ruby

update: i was precompiling my assets and apparently should've been letting heroku do that. thanks @drapergeek !!!

I'm seeing this same issue after upgrading from 0.5.7 to 0.7.2. heroku run rake ember:compile doesn't give any output. I have the following setup:
ember.rb
EmberCli.configure do |config|
  config.app :frontend
end

routes.rb
mount_ember_assets :frontend, to: '/'
mount_ember_app :frontend, to: '/*path'

app/views/ember_cli/ember/index.html.slim
= render_ember_app :frontend do |head|
  - head.append do
    = stylesheet_link_tag :application, media: :all
    = render 'layouts/timezone_restriction'
    = favicon_link_tag '/favicon.ico?v=2'

ember-cli-build.js
/* global require, module */
var EmberApp = require('ember-cli/lib/broccoli/ember-app');

module.exports = function(defaults) {
  var app = new EmberApp(defaults, {});

  app.import('./bower_components/jQuery.dotdotdot/src/js/jquery.dotdotdot.min.js');
  app.import('./bower_components/moment/moment.js');
  app.import('./bower_components/mediaelement/build/mediaelement-and-player.min.js');
  app.import('./bower_components/typeahead.js/dist/typeahead.jquery.min.js');
  app.import('./bower_components/jquery-ui-sortable/jquery-ui-sortable.min.js');
  app.import('./bower_components/jquery-ui-touch-punch-improved/jquery.ui.touch-punch-improved.js');

  return app.toTree();
};

environment.js
/* jshint node: true */

module.exports = function(environment) {
  var ENV = {
    modulePrefix: 'frontend',
    environment: environment,
    baseURL: '/',
    locationType: 'auto',
    'ember-simple-auth': {
      routeAfterAuthentication: 'asanas'
    },
    EmberENV: {
      FEATURES: {}
    },
    APP: {}
  };

  if (environment === 'development') {
    ENV.APP.LOG_RESOLVER = true;
    ENV.APP.LOG_ACTIVE_GENERATION = true;
    ENV.APP.LOG_TRANSITIONS = true;
    ENV.APP.LOG_TRANSITIONS_INTERNAL = true;
    ENV.APP.LOG_VIEW_LOOKUPS = true;
  }

  if (environment === 'test') {
    // Testem prefers this...
    ENV.baseURL = '/';
    ENV.locationType = 'none';

    // keep test console output quieter
    ENV.APP.LOG_ACTIVE_GENERATION = false;
    ENV.APP.LOG_VIEW_LOOKUPS = false;

    ENV.APP.rootElement = '#ember-testing';
  }

  if (environment === 'production') {}

  return ENV;
};

heroku
$ heroku buildpacks
1. https://github.com/heroku/heroku-buildpack-nodejs
2. https://github.com/heroku/heroku-buildpack-ruby

$ heroku config | grep ENV
RACK_ENV:                     production
RAILS_ENV:                    production

$ heroku config | grep EMBER

Everything builds fine locally. The issue is only present on Heroku. Is it possible some previous config from 0.5.x is short circuiting everything?

I used redis based setup finally.
--
On 02.03.2016 at 18:33 GMT Ryan Linton wrote:

I'm seeing this same issue after upgrading from 0.5.7 to 0.7.2. heroku run rake ember:compile doesn't give any output. I have the following setup:
ember.rb
EmberCli.configure do |config| config.app :frontend end
routes.rb
mount_ember_assets :frontend, to: '/' mount_ember_app :frontend, to: '/path'
app/views/ember_cli/ember/index.html.slim
= render_ember_app :frontend do |head| - head.append do = stylesheet_link_tag :application, media: :all = render 'layouts/timezone_restriction' = favicon_link_tag '/favicon.ico?v=2'
ember-cli-build.js
/ global require, module / var EmberApp = require('ember-cli/lib/broccoli/ember-app'); module.exports = function(defaults) { var app = new EmberApp(defaults, {}); app.import('./bower_components/jQuery.dotdotdot/src/js/jquery.dotdotdot.min.js'); app.import('./bower_components/moment/moment.js'); app.import('./bower_components/mediaelement/build/mediaelement-and-player.min.js'); app.import('./bower_components/typeahead.js/dist/typeahead.jquery.min.js'); app.import('./bower_components/jquery-ui-sortable/jquery-ui-sortable.min.js'); app.import('./bower_components/jquery-ui-touch-punch-improved/jquery.ui.touch-punch-improved.js'); return app.toTree(); };
environment.js
/ jshint node: true */ module.exports = function(environment) { var ENV = { modulePrefix: 'frontend', environment: environment, baseURL: '/', locationType: 'auto', 'ember-simple-auth': { routeAfterAuthentication: 'asanas' }, EmberENV: { FEATURES: {} }, APP: {} }; if (environment === 'development') { ENV.APP.LOG_RESOLVER = true; ENV.APP.LOG_ACTIVE_GENERATION = true; ENV.APP.LOG_TRANSITIONS = true; ENV.APP.LOG_TRANSITIONS_INTERNAL = true; ENV.APP.LOG_VIEW_LOOKUPS = true; } if (environment === 'test') { // Testem prefers this... ENV.baseURL = '/'; ENV.locationType = 'none'; // keep test console output quieter ENV.APP.LOG_ACTIVE_GENERATION = false; ENV.APP.LOG_VIEW_LOOKUPS = false; ENV.APP.rootElement = '#ember-testing'; } if (environment === 'production') {} return ENV; };
heroku
$ heroku buildpacks 1. https://github.com/heroku/heroku-buildpack-nodejs 2. https://github.com/heroku/heroku-buildpack-ruby $ heroku config | grep ENV RACK_ENV: production RAILS_ENV: production $ heroku config | grep EMBER
Everything builds fine locally. The issue is only present on Heroku. Is it possible some previous config from 0.5.x is short circuiting everything?
—
Reply to this email directly or https://github.com/thoughtbot/ember-cli-rails/issues/380#issuecomment-191362427<>.

@ryanlntn thanks for providing all that extra context.
mount_ember_app :frontend, to: '/*path'

The dynamic segment glob can be omitted:
mount_ember_app :frontend, to: '/l

heroku run rake ember:compile doesn't give any output

The current implementation of the Rake task will only output on errors.
Additionally, given the way dynos work, I don't think compiling the frontend after the fact will persist the EmberCLI generated files to the file system.
Does your deploy invoke rake assets:precompile? The gem creates a dependency on that task.

@seanpdoyle It is being invoked:
remote: -----> Preparing app for Rails asset pipeline
remote:        Running: rake assets:precompile
remote:        ** [Honeybadger] Starting Honeybadger version 2.5.1 level=1 pid=619
remote:        Asset precompilation completed (15.93s)
remote:        Cleaning assets
remote:        Running: rake assets:clean

@ryanlntn what are your package.json versions for:

ember-cli
ember-cli-rails-addon

@seanpdoyle
"ember-cli": "1.13.13",
"ember-cli-rails-addon": "~> 0.7.0"

@ryanlntn just to clarify -- you've followed all the steps for [setting up Heroku], including running the generators and executing:
$ heroku config:set NPM_CONFIG_PRODUCTION=false

and you're still seeing the following?

EmberCLI failed to generate an index.html file.

@tute since we've just recently worked through a similar issue, do you have any guess as to what's causing this?

@seanpdoyle Yeah. I've followed all the Heroku setup steps in the readme and I'm seeing that error.

@tute since we've just recently worked through a similar issue, do you have any guess as to what's causing this?

The problem I had was that my frontend/ember-cli-build.js was doing var deploy = require('./config/deploy');, but I had removed that file (made sense only for deploying to S3 and redis) and forgot to remove the require line. So it was a Javascript error that wasn't being surfaced.

it was a Javascript error that wasn't being surfaced.

@ryanlntn could you try running:
$ rm -rf frontend/{tmp,dist} tmp/ember-cli
$ RAILS_ENV=production bundle exec rake assets:precompile
$ cat tmp/ember-cli/apps/frontend/index.html

@ryancoughlin what version of node are you using?

@seanpdoyle This is the output that gives me:
<!DOCTYPE html>
<html>
  <head>
    <meta charset="utf-8">
    <meta http-equiv="X-UA-Compatible" content="IE=edge">
    <title>Sequenched</title>
    <meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1">
    <meta name="description" content="Sequenched is your yoga class sequence builder. Asana, pranayama, mantra & amazing sample yoga classes. Plan your classes now for free. All devices."
>

    <base href="/" />

    <link rel="stylesheet" href="assets/vendor-d41d8cd98f00b204e9800998ecf8427e.css" integrity="sha256-47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU= sha512-z4PhNX7vuL3xVChQ1m2AB9Yg5AULVxXcg/SpIdNs6c5H0NE8XYXysP+DGNKHfuwvY7kxvUdBeoGlODJ6+SfaPg==" >
    <link rel="stylesheet" href="assets/frontend-d41d8cd98f00b204e9800998ecf8427e.css" integrity="sha256-47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU= sha512-z4PhNX7vuL3xVChQ1m2AB9Yg5AULVxXcg/SpIdNs6c5H0NE8XYXysP+DGNKHfuwvY7kxvUdBeoGlODJ6+SfaPg==" >
    <link rel="shortcut icon" type="image/x-icon" href="/favicon.ico?v=2">

  </head>
  <body>

    <script src="assets/vendor-fa4c3361719a64a2b310a3d2a7547a69.js"></script>
    <script src="assets/frontend-1ebae450b20e52a49a09e32b214e016a.js"></script>

  </body>
</html>

@tute I'm running v5.6.0.

I saw several questions with same error message (but regarding to Heroku) but I could not fix mine.
I built a docker container image, but the ember app can not be displayed:
I, [2016-03-21T20:56:07.939303 #24]  INFO -- : Started GET "/app" for <IP_ADDRESS> at 2016-03-21 20:56:07 +0000
I, [2016-03-21T20:56:08.001556 #24]  INFO -- : Processing by EmberCli::EmberController#index as HTML
I, [2016-03-21T20:56:08.001666 #24]  INFO -- :   Parameters: {"ember_app"=>:frontend}
D, [2016-03-21T20:56:08.018137 #24] DEBUG -- :   User Load (0.5ms)  SELECT  `users`.* FROM `users` WHERE `users`.`id` = 1  ORDER BY `users`.`id` ASC LIMIT 1
D, [2016-03-21T20:56:08.044932 #24] DEBUG -- :   Company Load (0.4ms)  SELECT  `companies`.* FROM `companies` WHERE `companies`.`id` = 2 LIMIT 1
I, [2016-03-21T20:56:08.068090 #24]  INFO -- :   Rendered ember_cli/ember/index.html.erb (5.6ms)
I, [2016-03-21T20:56:08.068361 #24]  INFO -- : Completed 500 Internal Server Error in 67ms
F, [2016-03-21T20:56:08.069969 #24] FATAL -- :
ActionView::Template::Error (          EmberCLI failed to generate an `index.html` file.
):
    1: <%= render_ember_app ember_app do |head, body| %>
    2:     <% head.append do %>
    3:         <%= csrf_meta_tags %>
    4:     <% end %>
  app/views/ember_cli/ember/index.html.erb:1:in `_app_views_ember_cli_ember_index_html_erb___227654452272873356_47299009572860'

Inside container there is a RAILS_ENV=production .
Here is my configuration:
# config/routes.rb
mount_ember_app :frontend, to: '/app'

# config/initializers/ember.rb
EmberCli.configure do |c|
  c.app :frontend
end

// frontend/config/environment.js
module.exports = function (environment) {
  var ENV = {
    modulePrefix: 'frontend',
    environment: environment,
    baseURL: '/app',
    locationType: 'auto',
    EmberENV: {
      FEATURES: {
      }
    },

    APP: {
      // Here you can pass flags/options to your application instance
      // when it is created
      host: 'http://localhost:3000',
      app_fixtures: {
        display_name: 'John Doe',
        first_name: 'John',
        last_name: 'Doe'
      }
    }
  };

  if (environment === 'development') {
  }

  if (environment === 'test') {
    // Testem prefers this...
    ENV.baseURL = '/';
    ENV.locationType = 'none';

    // keep test console output quieter
    ENV.APP.LOG_ACTIVE_GENERATION = false;
    ENV.APP.LOG_VIEW_LOOKUPS = false;

    ENV.APP.rootElement = '#ember-testing';
  }
  if (environment === 'production') {
  }
  return ENV;
};

I have ember cli 2.3.0 and ember-cli-rails-addon 0.7.0 installed.
My docker container is built by:
FROM rails:onbuild

RUN apt-get update -qq && apt-get install -y build-essential nodejs npm nodejs-legacy
RUN npm install -g phantomjs
RUN npm install -g bower

RUN echo '{ "allow_root": true }' > /root/.bowerrc

RUN bundle exec rake assets:clean
RUN bundle exec rake assets:precompile

CMD ["unicorn", "--config-file", "./config/unicorn.rb", "--host", "<IP_ADDRESS>", "--port", "3000"]

@seanpdoyle any idea?
Also, in my production.rb I have
config.serve_static_files = true

After debugging I noticed that gem is trying to load Rails.root.join("tmp/ember-cli/apps/frontend/index.html"), and inside my docker container I had an empty frontend directory.
This lead me to think about compilation of assets - then I saw that there is no ember-cli installed so I added
RUN npm install ember-cli

just after RUN npm install -g bower. As node version is 0.10.x, I had to add one more command
RUN cd frontend && npm rebuild node-sass

I rebuilt image and it is working. However, environment is still development. I had to add RAILS_ENV=production to docker run command
RUN bundle exec rake assets:precompile RAILS_ENV=production

Now everything is up and running.
Basically, the problem was that ember compile did not finish with success (thus frontend dir was empty) but assets:precompile finished with success (no errors were given) as I did not have ember-cli installed.
If the error was saying please install ember-cli first (like it does for bower and node) and assets:precompile has failed, it would save so much time. I spent hours looking in configuration files, integrations, etc..

@bajalovic thanks for getting to the bottom of this!
ember compile not failing and raising an error is a known issue.
A fix has been merged into master, but a release is blocked by https://github.com/thoughtbot/ember-cli-rails/pull/423#discussion_r56713884.


[bash] Multiline C-r without histexpand

> echo 'foo
bar'

Previously, if you C-r and select the bar' line, your command line remains empty: __fzf_history__() fails because the the selected line doesn't start with a history number.
If you select the echo 'foo line, it pastes both lines only if histexpand is enabled.
If you search for foo bar, neither line is found.
Fixes #1370

Thanks for taking a stab at the issue, but I won't merge this for the following reasons:

The sed command used doesn't work on macOS unless you manually installed GNU sed
I prefer having index numbers. They help me grok the relative ordering of the commands, and I sometimes rely on them to pinpoint the exact command I want. Also, I don't want to break backward compatibility.
The additional sed process makes getting the entire list slower.> HISTTIMEFORMAT= builtin history | wc -l
  122501
> time HISTTIMEFORMAT= builtin history > /dev/null

real    0m0.095s
user    0m0.068s
sys     0m0.028s
> time HISTTIMEFORMAT= builtin history | gsed -E -e :a -e 'N;$!ba' -e 's/(^|\n) *[1-9][0-9]*[ *] /\x00/g' > /dev/null

real    0m0.450s
user    0m0.427s
sys     0m0.145s

Any delay is noticeable because we use --tac --sync. Having no delay is much more important to me because I face the delay every time I press CTRL-R which is very often, while I rarely have to fetch a multi-line command from the middle of it.

I also have to mention that I'm not interested in adding more options for configuring the behavior because maintaining these scripts for three different shells has been really painful to me and I don't want to increase the complexity anymore. Users can easily override these functions in their shell configuration files. And I believe more advanced implementations should be external, third-party projects.
Anyway, thanks again for your interest in the project.


[MM-20599] Migrated select_team component to Typescript

Summary
Select Team Component - TypeScript Migration
Ticket Link
https://github.com/mattermost/mattermost-server/issues/13475

Thanks for making those changes. Those look good to me, although there are some unintended changes included on the branch now. Would you be able to remove those yourself? If not, I can do some git magic to get rid of them.

@hmhealey  Thanks. I will remove those commits.

@hmhealey Please check now.

/update-branch

Thanks for the contribution @diode :+1:


Set up initFromBackup correctly

Fixes https://github.com/Alluxio/alluxio/issues/9969 by addressing the regression  in PR #9808

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/5766/
Test FAILed.

Jenkins, test this please

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/5787/
Test FAILed.

Jenkins, test this please

@ZacBlanco I have no context on this feature and what should be tested. This PR is purely to revert some change I made accidentally in #9808 which cleans up the use of UnderFileSystem factory methods but try to use UfsManager more

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/5790/
Test PASSed.

I know this is reverting a previous change, but it broke the functionality described in #9969
If we're reverting the change we should be adding a test to ensure it doesn't happen again

Closing this as I've opened a continuation of this PR in #10046


Fix Windows environment set issue and change to env to params for compatibility

Hi.
All environment values changed to -- params for compatibility reasons.
I've tested on my project (on Windows) and working as expected. ( Except --url param which I don't have but I assume it'll work.)
Thank you for this great addon.

How about now? I think this is better.


(BEAKER-1599) Execute repeats retry logic

This commit removes the nested retry logic from the execute method. Without this change the retry logic in connect_block is duplicated in execute, creating nested retry logic, which causes beaker to take longer than expected to fail.

Because of current product releases I'm going to wait to release this until tomorrow morning rather than right now.


Document SQLite 3.35 requirement

Waiting for the outcome of https://github.com/dotnet/efcore/issues/28776 before merging, since we might decide to change this.

If you're using SQLitePCLRaw.bundle_winsqlite3, the minimum required version of Windows 10 is 1903


feat: adding the origin configuration to the manifest

Adding the origin configuration to the manifest.
Example:
azion.config.js

export default {
  origin: [
    {
      name: "my origin storage",
      type: "object_storage",
      bucket: "mybucket",
      prefix: "myfolder",
    },
  ],
  rules: {
    request: [
      {
        match: "/^/_statics/;", // start with /_statics
        setOrigin: {
          name: "my origin storage",
          type: "object_storage",
        },
      }
    ],
  },
};

The manifest generated in: ./.edge/manifest.json
{
  "origin": [
    {
      "name": "my origin storage",
      "origin_type": "object_storage",
      "bucket": "mybucket",
      "prefix": "myfolder"
    }
  ],
  "cache": [],
  "rules": [
   ...
    {
      "criteria": [
        [
          {
            "variable": "${uri}",
            "operator": "matches",
            "conditional": "if",
            "input_value": "/^/_statics/;"
          }
        ]
      ],
      "behaviors": [
        {
          "name": "set_origin",
          "target": "my origin storage"
        }
      ]
    }
  ]
}

:tada: This PR is included in version 2.6.0-stage.12 :tada:
The release is available on:

npm package (@stage dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 2.6.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


FIx issues

I went through the yarn issues and fixed most bad names, but avoided the more controversial changes. This PR fixes:

Closes https://github.com/FabricMC/yarn/issues/678
Closes https://github.com/FabricMC/yarn/issues/676
Closes https://github.com/FabricMC/yarn/issues/668
Closes https://github.com/FabricMC/yarn/issues/666
Closes https://github.com/FabricMC/yarn/issues/665
Closes https://github.com/FabricMC/yarn/issues/656
Closes https://github.com/FabricMC/yarn/issues/654
Closes https://github.com/FabricMC/yarn/issues/637
Closes https://github.com/FabricMC/yarn/issues/634
Closes https://github.com/FabricMC/yarn/issues/619
Closes https://github.com/FabricMC/yarn/issues/594
Closes https://github.com/FabricMC/yarn/issues/571
Closes https://github.com/FabricMC/yarn/issues/499
Closes https://github.com/FabricMC/yarn/issues/121
Closes https://github.com/FabricMC/yarn/issues/121

Additionally, these issues seem to have been fixed in previous PRs, or don't seem to be an issue anymore:

Closes https://github.com/FabricMC/yarn/issues/552
Closes https://github.com/FabricMC/yarn/issues/476
Closes https://github.com/FabricMC/yarn/issues/384
Closes https://github.com/FabricMC/yarn/issues/297
Closes https://github.com/FabricMC/yarn/issues/171
Closes https://github.com/FabricMC/yarn/issues/170
Closes https://github.com/FabricMC/yarn/issues/94

Was just about to point out that duplicate class ^ ;)

Looks really good, nice work!

@modmuss50 consider merging? This Unit rename helps me so much.


⚠ Bofrost.es has degraded performance

In d2e71d4, Bofrost.es (https://www.bofrost.es) experienced degraded performance:

HTTP code: 200
Response time: 1421 ms

Resolved: Bofrost.es performance has improved in dfb1476 after 7 minutes.